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LIMIT  THEOREMS  FOR  FISHER-SCORE  CHANGE  PROCESSES 


by  Lajos  Horvath  and  Emanuel  Parzen* 

University  of  Utah  and  Texas  A&M  University 

0.  Introduction 

Change  analysis  is  concerned  with  distinguishing  “fluctuation”  of  the  data  (in  ac¬ 
cordance  with  probability  distributions  fitted  to  a  whole  sample)  from  “non-stationarity” 
(changes  in  the  parameters  of  probability  distributions).  To  detect  change  over  time  in  a 
sequence  of  observations  one  forms  for  various  transformations  of  the  data  sample  change 
processes  on  [0,1];  the  transformations  are  called  “data  score  functions”  (Parzen  (1992)). 

One  can  choose  non-parametric  score  functions  which  detect  changes  of  location,  scale, 
skewness,  etc.  in  the  probability  distribution  of  the  observations.  When  a  parametric 
model  is  available  for  the  distribution  of  each  observation  one  can  detect  changes  in  the 
parameter  values  by  transforming  the  data  by  parametric  score  functions  which  we  call 
Fisher-score  functions. 

This  paper  studies  the  asymptotic  distributions  (under  the  null  hypothesis  of  no 
change)  of  Fisher-score  change  processes  which  are  cusums  of  scored  data.  They  are 
related  to  cuscore  processes  or  cumulative  score  processes,  some  of  whose  applications  are 
described  in  Box  and  Ramirez  (1992). 

1.  Fisher-score  change  processes 

Let  Xj,  X2, . . . ,  X„  be  independent  random  vectors  with  distribution  functions  F(x; 

©l),  F(x;  ©2), . . . ,  F(x;  ©n),  where  ©1,  ©2, . . . ,  ©n  are  unknown  p-dimensional  parameter 
vectors.  A  basic  changepoint  probl  im  is  the  problem  of  “abrupt  change”  which  tests 

H0  I  ©1  =  ©2  =  •••  =  ©n  jv _ 
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against  the  alternative  Hj^  '  There  is  re( 0, 1)  such  that 


01  —  ...  —  0[nT]  ^  ®[nr]+l  —  •  ■  •  —  0n- 


The  “abrupt  change”  problem  motivates  the  definition  of  the  Fisher-score  change  processes 
introduced  in  (1.3).  We  digress  for  a  moment  to  note  that  test  statistics  for  smooth  change 
models  can  be  formed  by  inner  products  of  these  processes  with  “change  score  functions.” 

We  assume  that  the  observations  Eire  absolutely  continuous  or  discrete.  The  density 
functions  (probability  mass  functions  in  the  discrete  case)  are  denoted  by  /(x;  ©i), . . . ,  /(x; 
©„). 


Let  gi(x;  0)  =  (0i,i(x;  0), . . . ,  <7i,p(x;  0)),  defining  Fisher-score  functions 


We  estimate  the  unknown  parameter  by  the  usual  maximum  likelihood  method;  i.e.  0„  = 
(0n,i>  •  •  • ,  ©n,p)  satisfies  the  estimating  equations 


5^  91, i  (Xj;0n)  =0,  1  <  i  <  p-  (1.1) 

l<j<n 

A  basic  statistic  in  changepoint  problems  is  the  process  on  0  <  t  <  1 


Z«(f)  —  . . . ,  Zn,p(t))  ,  (1.2) 

whose  components  are  called  Fisher-score  change  processes  defined  by 

Zn,i{t)  =  - 72  01, i  (x7-; On)  ,o  <  t  <  1, 1  <  t  <  p  (1.3) 

n  l<J<(n+l)i 

(Zn  ,(l)  =  0, 1  <  t  <  p ).  They  can  be  considered,  for  t  fixed,  to  be  score  test  statistics 
for  the  hypothesis  that  the  parameter  estimators  for  data  up  to  time  (n  +  l)t  are  not 
significantly  different  from  the  parameter  estimators  for  all  the  data,  against  the  alternative 
hypothesis  that  there  is  abrupt  change  at  time  (n  +  l)t. 

We  study  the  asymptotic  properties  of  Z n(t)  under  the  null  hypothesis  of  no  change. 
The  true  value  of  the  parameter  under  Hq  is  denoted  by  Oq  =  (©o,l,  •  •  • ,  ©o,p)-  Let  X 
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be  a  random  vector  with  density  function  (probability  mass  function  in  the  discrete  case) 
/(x;Oq).  Let 

<7(x;0)  =  log/(x;0) 

0)  =  6)>  1  ^  ^  P 

d2 

mste 0)  =  dQ~dQ~j9^ e)>  1  -  *’■ 3  -  p 

and 

& 

0)  =  e^aeJSei9^’1  -  i’j’k-p 

We  assume  that  there  is  an  open  neighborhood  0q  of  ©o  such  that  the  following  conditions 
hold: 

C.l  y(x;0),  <7!j(x;  0),  g2}ij(x’,e)  and  g3>i jik(x;  0)  1  <  i,j,k  <  p  exist  for  all  xeRd  and 
0e©o 


C.2  There  is  a  function  M(x)  such  that  EM(X)  <  oo  and  for  all  xeRd,  0e©o 

lfl,l,i(x;0)|  <M(x),  1  <i<p 

0)1  <  M(x),  1  <  *  <  P 

l<73,«,j,i(x; 0)1  <  M(x),  1  <i,j,k<p 

C.3  Egi'i(X; 0O)  =  0,  l<i<p 

C.4  E\g\ t,(X;  ©o)|2+^  <  oo,  1  <  *  <  p,  for  some  6  >  0 

C.5  J~l  exists,  where  J  =  {J,j,  1  <  <  p}  and  =  2?yi,*(X;  0o)9l,j(X;  ©0),  1  < 

*\  j  <P 

C.6  £|92iij(X;6o)|2  <  oo 

We  show  that  Z n(t)  converges  weakly  to  T(<)  =  ...,r^(t)),  where  T(<) 

is  a  Gaussian  process  with  covariance  structure  ET^\t)  —  0  and  = 

JiA  min(f,  s)  —ts).  This  means  that  J-  is  a  Brownian  bridge  for  each  1  <  i  <  p. 

To  consider  the  convergence  in  weighted  metrics,  we  consider  the  following  class  of 
functions: 


<Jo,l  =  {9:7  non-decreasing  in  a  neighborhood  of  zero,  non- increasing  in  a  neighbor¬ 
hood  of  one  and  inf s<t<l-6  q(t)  >  0  for  all  0  <  8  <  1/2}. 
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The  condition  is  given  in  terms  of  the  integral  test 

Theorem  1.1.  We  assume  that  (1.1)  has  a  unique  solution,  C.1-C.6  hold  and 
<Z»cQo,l>  1  <  *  <  p.  We  can  define  a  sequence  of  Gaussian  processes  {I*n(t)  = 

(rn|i(t), . . .  ,rn,p(t)),  0  <  t  <  1}  such  that 

{r„(t),  o  <  t  <  1}  =  {r(<),  o  <  t  <  i}  (i.4) 


and 


if  and  only  if 


max  sup 
1<*<P0<*<1 


\Zn,i{t)-Tn<i{t)\/qi{t)  =  op{\) 


(1.5) 


max  I(q{,c )  <  oo  for  all  c  >  0.  (1.6) 

1<‘<P 

If  we  are  interested  in  the  convergence  of  the  weighted  supremum  functional,  we  can 
establish  it  under  weaker  conditions. 


Theorem  1.2.  We  assume  that  (1.1)  has  a  unique  solution,  C.l  -  C.6  hold  and 
9icQo,l>  1  <  *  5:  P-  Then,  as  n  -*  oo,  we  have 

{  sup  |^nll(0l/«l(0»--*»  SUP  I Zn,p\/qp{t)\  (1-7) 

V0<t<l  0<*<1  J 

°  f  sup  irWwi/nto,...,  sup  |rW(<)|/9p(()| 
lO<«l  0«<1  J 

if  and  only  if 


max  I  (qi,  c)  <  oo  for  some  c  >  0. 


(1.8) 


We  can  choose  qi(t)  =  (t(l  —  t)  log  log  l(f(l  —  t )))*/2  in  Theorem  1.2  but  this  function 
does  not  satisfy  (1.6).  However,  the  standard  deviation  ( J,-  ,t(l  —  <))*/2  does  not  satisfy 
(1.6)  nor  (1.8).  Let 

a(x)  =  (21ogx)1/2 


Kx)  =  2  log  X  +  i  log  log  X  -  i  log  7T. 
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Theorem  1.3.  We  assume  that  (1.1)  has  a  unique  solution  and  C.1-C.6  hold.  Then  for 
each  1  <  i  <  p  we  have 


Km  P  1  a(lo«n)  SUP  lZn,i(<)l/  (JiA1  ~  <))1/2  ^  *  +  6(loSn)  \  (1-9) 

n^°°  l  0<t<l  J 

=  exp(— 2e~x) 


for  all  x. 

We  note  that  if  =  0,i  ^  j,  then  a(logn)  sup0<<<i  |Zn)1-(t)|/  - 1))1^2  - 

6(logn)  and  a(logn)supo<«i  \Znj(t)\/  (Jjjt(  1  —  t))1^2  —  6(logn)  are  asymptotically  in¬ 
dependent.  This  happens,  for  example,  if  the  observations  axe  normal  and  the  parameters 
are  the  mean  and  the  variance. 


2.  Proofs 

We  start  with  a  few  lemmas.  We  assume  that  Hq  holds.  Let  ||x||  =  max^<j<p  |x,-|, 
x  =  (xi,...,xp). 

Lemma  2.1.  We  assume  that  (1.1)  has  a  unique  solution  and  C.1-C.6  hold.  Then ,  as 
n  -+  oo,  we  have  for  all  1  <  i  <  p  that 

z»,i«=z;, ,■(«)+ <!(*>+< Iw, 


where 


7jn,A)  1/2  j  9l’'  (Xi;  ®°)  * 

tl<j<(n+l)t  l<J<n 

0<"?1  =  °p  (n"1/2) 


and 


*>p  i<2Jmi/«i  -  <))  =  op(  i). 

l/(r»-|-l)<i  <  1—  l/(r»H- 1) 


PROOFS.  Conditions  C.l  -C.4  imply 


II h  -  e0||  0(1) 


(2.1) 
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as  n  — ♦  oo,  and  therefore  we  can  assume  that  0ne0Q.  Ibragimov  and  Hasminskii  (1972, 


1973a, b)  showed  that 


We  write 


where 


We  note  that 


l|n(i„-0o)-  E  gi(Xi;e0).7-I||=o!,(.>). 

l<7<n 


gi(e)  =  Egi(Xi6o) 


^n,i(0  —  +  <](<). 


=  E  n,,(x,:6„) 

l<i<(n+l)( 


rl,i  (xj©)  =  91, i  (x;  0)  -  91, i  (©) ,  1  <  i  <  p. 


T2,ij  (x;  ©)  =  0-tm(x;0) 

tj,.  j,t  (*;  ®)  =  (x;  e>  • 


ET2j,j  (X;  Go)  =  0,  1  <  i,  j  <p 


\T3,iJ,k  (x)J  <  2 M(x). 

A  two-term  Taylor  expansion  and  (2.2)  with  the  central  limit  theorem  yield 
9l,i  (©n)  ~  9l,t  (©0)  =  5Z  &,i j  (©0)  (©n,i  “  ©0,») 


i<i<p 


o 
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Next  we  use  again  (2.2)  and  get 


n  (©n)  “  91, i  (©o))  =  82 ,»  (®o)  ^  X  81  (X*  ©o)  ^ 
+  op  (ra1//2)  • 


\l<*<n 


(2.9) 


Observing  that  g2,i,j(&o)  =  -  JiJ,  by  (2.9)  we  have 

«  (tfl.i  (©n)  -  9\,i  (©O))  =  ~  X  (X*;  ®°)  +  0p  (nl/2)  '  (2‘10) 


l</<n 

We  use  again  Taylor  expansion  and  get 

|  £  (n,i(x<;e0)-r1,,(X/;eo))  (2.11) 

l<e<(n+l)t 

-  X  (®"J  -  e0j)  XI  r2,«,i  (xf ;  eo)  I 

l<j<p  l<£<(n+l)i 

<|lien-©oll2  X  M(x*)- 

1<<<(”+1)< 

Now  by  (2.6)  we  can  use  the  invariance  principle  and  by  C.2  we  can  apply  the  law  of  large 
numbers.  Thus  we  obtain 


sup  I  E  (tm  (x*  ®o)  -  Ti.i  (x«;  e0))  |  =  op( i).  (2.11) 

°-*-1  l<£<(n+l)t 


We  showed  that 


sup 

0<t<l 


i 


E  ji..(xj;8o)I  =  °p("'i/2) 

i<;<(»+i)< 


(2.12) 


~p  i(^iW+4j  E  ?i,t(xjieo)  ]  /*i =oP(i). 

0<K1  \  n  /  l<i<n  ) 


By  (1.1)  we  have 

^n,i(*)  =  —  X  ^1  ,i  (XjJ  ©n)  i 
(n+l)«j<n 


(2.13) 


7 


and  therefore  similarly  to  (2.3)  we  have 


\z«,i(t)  -  -L  (  E  <x*  8»)  -  ‘  E  ®o) )  i 

”  \l<^<(n+l)<  1  <l<n  ) 

<  | n_1/2  |  (,9l,i  (Xj; 8„)  -  9i,i  (©n))  -  91  (Xj;  0 o) }  I 

(n+l)t<j<n 

+ (»>.'•  (®»)  - (®o))  +  ^71  E  (X* ®o)  I 
=  <]w + <!(<)• 


Now  similarly  to  (2.12)  and  (2.13)  one  can  establish 


sup,  |A(n*](t)|  =  Op  (n  1/2) 


0<t<l 


sup  J(0I/(1  -  <)l  =  °p(1)? 

l/(n+l)<f<l— l/(n+l) 
which  completes  the  proof  of  Lemma  2.1. 

Lemma  2.2.  We  assume  that  C.3  and  C.4  hold.  We  can  define  a  sequence  of  Gaussian 
processes  {!%,(*)  =  (rn,i(t), . . .  ,rn,p(*)),0  <  t  <  1}  such  that  (1.4)  holds  and 


nJ  max 


max  sup  |Z*,(t)  -  rn,i(t)|/(t(l  -  *))"  =  0P(  1) 

1<*<P  l/(n+l)<t<n/(n+l) 


for  all  <  v  <  1/2. 

PROOF.  Let 


v„,i(f)=  E  nri*;;®.). 

!<;'<(n+l)< 


(2.14) 


V„,i(l)=  E  Si.i(Xj;6„). 
l<;<n 


We  have 


B,„z.  .  (  MO  - » (M  (1)  +  (MD  -  ^  (I)))  ..s.sl 

l  -  (Mi)  -  MO)  +  (i  -  0  (v.,.  ($)  +  (MO  -  v.,i  ($))) ,  \  <  ( <  i. 


By  Einmahl  (1989)  for  each  n  we  can  define  two  independent  Gaussian  processes 
{(G4!i(*)'---»G!Sp(*))»0  ^  ^  ”/2}  and  {(GS(x),...,cg(x)),0  <  X  <  n/2}  with 

covariance  EG„](x)  =  0,  £G^J(x)G^(y)  =  .7**  min(x,y),  j  =  1,2,  1  <  i,  k  <  p  and 

1  _ 

(2.16) 


max  sup  |VB|i(0  -  G^(n#)|/(n<)2  +  6  =  Op(  1) 
l<«<Pl/(„+l)<t<l/2 


and 


max  sup  l(V’„1i(l)-V-„,i(())-G^>(n(l-())l/(u(l-«))2  +  i  =0,(1).  (2.17) 

l<»<Pl/2<<<n/(n+l) 

Now  (2.15),  (2.16)  and  (2.17)  yield 


n\~v 


E  KM  -  n'1/2  «!h>  -  *  «]  (I) + g<3  (I)))  i/w" 

l/(n+l)<t<l/2 


=  sup  |n1/XiW-K(("0-<(G"iQ)+G2(j)))l/("l)‘'  (2.18) 

l/(n+l)<<<l/2  V  V  V2/// 

1 

=  Op(l)  sup  (n<)2  +  £  =  0P(1), 

l/(n+l)<f<l/2 


and  similar  arguments  give 


1  —  j/ 

r»J  v 


sup  |z‘‘iW  -  n-1/2(-Cf  J(n(l  -  0) 

l/2<<<n/(n+l)  ’  V  ’ 

+ (i  -  o  «i  (?) + (j)))i/(i  -  o- = oPd). 


(2.19) 


We  define  I\»(<)  by 

<!("')  - '  Ki  (?)  +  g2  (5)) ,  0  <  t  <  1/2 

<))  +  0-0  (g(2  (5)  +  g<2>  (5)) .  1/2  <  t  <  1. 

It  is  easy  to  see  that  Tn(t)  satisfies  (1.4)  and  by  (2.18),  (2.19)  we  have  (2.14). 


(  G*l)(n<)  -  f  ( 

n1/2r„,i(t)  =  {  1 

l  -cg(-(l  - 


PROOF  OF  THEOREM  1.1.  First  we  assume  that 


I(qi,c)  <  oo  for  some  c  >  0. 
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(2.20) 


By  Csorgo  et  al  (1986)  (2.20)  implies 


and 


limfl,-(<)/ yi  =  oo 

no 

(2.21) 

Km  ?.(<)/(!  -01/2  =  oo- 

(2.22) 

Let  e  >  0.  Lemma  2.1  implies 


sup  \Zn>i(t)  -  2*  i(t)\/qi(t )  =  Op(l) 
£<*<!-£ 


(2.23) 


and 


sup  |Z„,.(1)  -  z;,i(i)l/(*(l  -  <))1/2  =  Op(l).  (2.24) 

l/(n+l)<t<n/(n+l) 

Next  we  write 


sup  |Zn,f-(<)  -  Z^(t)\/qi(t)  (2.25) 

l/(»+l)<*<£ 

<  sup  tl/2/qi(t)  sup  \Zn>i(t)  -  Z*ti(t)\/t1/2 

0  <t<e  l/(n+l)<t<n/(n+l) 


and 


sup  |Z„,i(f)  -  ZV(f)|/,;(t)  (2.26) 

1— £<t<n/(n+l) 

<  sup  (1  ~t)1/2/qi(t)  sup  |Zn)i(<)-^*(t)|/(l-t)1/2 

l-e<t<l  l/(n+l)<f<n/(n+l) 

Putting  together  (2.21)  -  (2.26)  and  choosing  e  as  small  as  we  wish  we  get 


sup  | ZBij(0  -  Z*ti(t)\/qi(t)  =  op(l).  (2.27) 

l/(n+l)<f<n/(n+l) 

Using  Lemma  2.2  with  v  =  1/2  we  have 


sup  i  z;f(<)  -  r„,.(()l/(<(i  -  *))I/2  =  op(  1).  (2.28) 

l/(n+l)<t<n/(n+l) 

Hence  by  (2.21)  and  (2.22)  similarly  to  (2.27)  we  can  establish 


sup  |ZV(i)  -  rn,j(()|/4j(()  =  Op(l).  (2.29) 

l/(n+l)<t<n/(n+l) 
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_  1  j2 

The  covariance  of  rn)l(<)  implies  that  J-  i  '  Tn>i(t)  is  a  Brownian  bndge  for  each  n.  By 
Csorgo  et  al  (1986)  condition  (1.6)  implies 


sup  |rn|i(OI/®(0  =  OpC1)  (2-30) 

0<<<l/(n+l) 


and 


sup  |rn,i(0l/9i(<)  =  Op(l)-  (2.31) 

n/(n+l)<t<l 

Now  (1.5)  follows  form  (2.27),  (2.29),  (2.30)  and  (2.31). 

Next  we  assume  that  (1.5)  holds.  It  follows  from  the  definition  and  (1.1)  that  Zn  ,-(f)  = 
0  if  0  <  t  <  l/(n  4-  1)  and  Zn)l-(t)  =  0  if  n/(n  +  1)  <  t  <  1.  Thus  we  have 


sup  |rBfj(t)|/?»-(0  =  op(l)  (2-32) 

0«<l/(n+l) 


and 


sup  |rBfi(t)|/9i(*)  =  op(l).  (2.33) 

n/(n+l)<*<l 


By  definition, 


{r„,i(t),0  <  t  <  1}  =  0  <  t  <  l}  (2.34) 

for  each  n,  where  {B(t),0  <  t  <  1}  is  a  Brownian  bridge.  We  have  (2.32)  and  (2.33)  if  and 
only  if 


lim  sup  |jB(t)|/<jr,(t)  =  0  a.s.  (2.35) 

*10  0<t<c 


and 


lim  sup  |i?(<)|/gt-(<)  =  0  a.s.  (2.36) 

elO  l-c<t<l 

Using  Csorgo  et  al  (1986)  we  get  that  (2.35)  and  (2.36)  imply  (1.6). 

PROOF  OF  THEOREM  1.2.  We  showed  in  the  proof  of  Theorem  1.1  that  (1.8) 
implies 


max  sup  | Z„ti(t)  -  Tnii(t)\/qi(t )  =  op(l) 

l<*<Pl/(n+l)<<<n/(n+l) 


(2.37) 
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Also,  (1.8)  yields  that  the  limiting  random  vector  is  almost  surely  finite  in  (1.7)  (cf.  Csorgo 
et  al  (1986)).  Since  Zn/Kt)  =  0,  if  0  <  t  <  1  /(n  +  1)  and  Zn>i(t)  =  0  if  n/(n  +  1)  <  t  <  1, 
the  limit  theorem  in  (1.7)  follows  from  (2.37). 

Now  we  assume  that  (1.7)  holds.  In  this  case  the  limiting  random  vector  is  almost 
surely  finite.  Using  (2.34),  this  can  happen  only  if  (1.8)  is  satisfied. 

The  proof  of  Theorem  1.3  is  based  on  the  following  lemma.  Let 


c(z)  =  log 


1  —  x 


Lemma  2.3.  We  assume  that  C.3  and  C.4  hold.  If  l/(n  +  l)  <  £i(n),  £2(n)  ^  n/(n  +  l), 


£l(n)  <  1  —  £2(n)  an(l 


then  we  have 


(l-ei(n))(l-e2(n))  _ 

lim  /  \  /  r  —  oo, 

n-KX>  ^l(n)e2(n) 


lim  ■?*{«  fx(c(£i(n))  +  c(£2(«))))  stip  \Z*  i{t)\f  (/,,,<(  1  -  t))] 
<x  +  b  Q«ei(n)))^  |  =  exp(— 2e“*) 


for  all  x. 


PROOF.  It  can  be  found,  for  example,  in  Csorgo  and  Horvath  (1990). 


PROOF  OF  THEOREM  1.3.  We  show  that 


sup  l^n,i(<)l/(<(1  ~  0)1/2  ^  SUP  \ZntM)\ /W1  ~  0)1/2 

l/(n+l)<t<n/(n+l)  l/(n+l)<t<n/(n+l) 


satisfy  the  same  limit  theorem.  By  Lemma  2.3  we  have 


sup  I -  Z'i(«)l/(<(1  -  f))1/2  =  Op(  1). 

l/(n+l)<<<n/(n+l) 


(2.38) 


Now  Lemma  2.3  yields 


(2  log  log  log  n)  1/2  sup  \Z*yi(t)\/ {Jitit(l-t))l/2  1 

l/(n+l)<t<(log  n)/n 


(2.39) 


and  therefore  by  (2.38)  we  have 


(2  log  log  log  n)-1^  sup  l^,i(*)K4.((1-())1/2-£l'  (2  «) 

l/(n+l)<i<(logn)/n 

It  is  easy  to  see  that  (2.40)  implies 

a(logn)  sup  |£„,i(*)|/  OMC1  "  f))V2  ~  (x  +  b^ogn))  £  -oo  (2.41) 

l/(n+l)<*<(logn)/n 
for  all  x.  Similar  arguments  give 

a(logn)  sup  |Znii(t)|/(JMt(l-t))1/2-(x  +  Klogn))^-oo.  (2.42) 

1— (logn)/n<f<n/(n+l) 

Using  again  Lemma  2.1  we  obtain 

sup  I Zn,i(t)  -  ^n,»(*)l/(*(l  ~  t))1^2  =  ^p(0°8n)  1//2)  (2.43) 

(log  n)/ n<<<  1/  log  n 

and 


sup  |Z„.i(!)  -  Z„”,,'(0I/(«(1  -  0)1/2  =  <V(logn)-1/2).  (2-«) 

1-1/  log  n<t<l— (log  n)/n 
Combining  (2.38)  with  Lemma  2.3  we  get 

a(logn)  sup  \Zn>i(t)\/(Ji,it{l-t))1/2 -(x  +  bi\°gn))^  -oo  (2.45) 

1  log  n<t<  1—1/  log  n 

for  all  x.  Similarly, 


a(logn)  sup  |Z*)i(t)|/(Jl,,<(l-t))1/2-(i  +  Klogn))^-oo.  (2.46) 

1/ log  n<t<l-l/ logo 

By  (2.41)-(2.46)  we  have 

lim  P  [  a(log  n)  sup  \Zn> ,-(*)!/  (Jtf  “  0)*/2  ^  +  ^og  n)  > 

n~*°°  [  l/(n+l)<t<n/(n+l)  J 

=  Urn  P  ( a(logn)  sup  |^,i(<)l/  (Ji\i*(l  “  *))1/2  ^  f 

n— *°°  (  (logn)/n<f<l-(logn)/n  J 

and  therefore  Lemma  2.3  implies  the  result  in  Theorem  1.3. 


13 


References 


Box,  G.  and  Ramirez,  J.  (1992).  Cumulative  score  charts.  Quality  and  Reliability  Engi¬ 
neering ,  8,  17-27. 

Csorgo,  M.,  Csorgo,  S.,  Horvath,  L.  and  Mason,  D.  M.  (1986).  Weighted  empirical  and 
quantile  processes.  Ann.  Probab.  14,  31-85. 

Csorgo,  M.  and  Horvath,  L.  (1990).  On  the  distributions  of  the  supremum  of  weighted 
quantile  processes.  Studia  Sci.  Math.  Hung.  25,  353-375. 

Einmahl,  M.  (1989).  Extensions  of  results  of  Komlos,  Major  and  Tusnady  to  the  multi¬ 
variate  case.  J.  Multivariate  Analysis  28,  20-68. 

Ibragimov,  I.  A.  and  Hasminskii,  R.  Z.  (1972).  Asymptotic  behaviour  of  statistical  esti¬ 
mators  in  the  smooth  case  I.  Study  of  the  likelihood  ratio.  Theory  Probability  Appl. 
17,  445-462. 

Ibragimov,  I.  A.  and  Hasminskii,  R.  Z.  (1973a).  Asymptotic  behaviour  of  some  statistical 
estimators  II.  Limit  theorems  for  the  posteriori  density  and  Bayes’  estimators.  Theory 
Probability  Appl.  18,  76-91. 

Ibragimov,  I.  A.  and  Hasminskii,  R.  Z.  (1973b).  On  the  approximation  of  statistical 
estimators  by  sums  of  independent  variables.  Soviet  Math.  Dokl.  14,  883-887. 

Parzen,  E.  (1992).  Comparison  Change  Analysis.  Nonparametric  Statistics  and  Related 
Topics  (ed.  A.  K.  Saleh),  Elsevier:  Amsterdam,  3-15. 


Lajos  Horvath 
Department  of  Mathematics 
University  of  Utah 
Salt  Lake  City,  UT  84112 


Emanuel  Parzen 
Department  of  Statistics 
Texas  A&M  University 
College  Station,  TX  77843-3143 


14 


